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MOMENT GROWTH BOUNDS ON CONTINUOUS TIME MARKOV 
PROCESSES ON NON-NEGATIVE INTEGER LATTICES 

MURUHAN RATHINAM* 

Abstract. We consider Markov processes in continuous time with state space Z^ and provide 
two sufficient conditions and one necessary condition for the existence of moments i?(||X(t)||'") of all 
orders r € N for all i > 0. The sufficient conditions also guarantee an exponential in time growth 
bound for the moments. The class of processes studied have finitely many state independent jumpsize 
vectors i/i , . . . , i^jv/ . This class of processes arise naturally in many applications such as stochastic 
models of chemical kinetics, population dynamics and queueing theory for example. We also provide 
a necessary and sufficient condition for stochiometric boundedness of species in terms of Uj . 

Key words. Continuous time jump Markov process, moment growth bounds, stochastic chem- 
ical kinetics, stochastic population dynamics. 
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1. Introduction. Markov processes in continuous time with the non-negative 
integer lattice as state space arise in stochastic models of chemical kinetics, predator- 

Ph . prey systems, epidemiology, queueing models etc. While the primary focus of this 

f~| ' paper shall be the Markov processes describing stochastic chemical kinetics, the results 

derived will be of use in other applications where the processes have similar structure. 
More specifically any Markov process model that evolves in continuous time on the 
state space Z^ and has finitely many types of jump events with fixed (state and time 
independent) jump sizes vi, . . . , vm will be the subject of study in this paper. 
- A stochastic chemical system with iV G N species and M G N reaction channels 

J^ I is described by a Markov process X{t) in continuous time i > with state space Z;^. 

vQ . The ith component Xi{t) describes the (random) number of species at time t. The 

probability law of the process is uniquely characterized by the stoichiometric matrix 

lO ' V which is A^ X M with integer entrees and the propensity function a : Z;^ — > MJ^ . 

^^ ' The functions aj : 1^ — )■ R+ are also known as intensity functions or rate functions. 

C^ . We shall use the term propensity which is used in chemical kinetics. The function 

CO ' (ijix) describes the "probabilistic rate" at which reaction j occurs while in state x. 

More precisely, given X{t) — x, the probability that reaction j occurs during (t, t + h] 
is given by aj{x)h + o{h) as h ^- 0+. Column vectors of v are denoted by Vj for 

(^ . j = 1,. . . ,M, and Vj describes the change of state due to one occurrence of reaction 

'^ I j. See [311] for general introduction to stochastic models in chemical kinetics. 

C^ . As an example consider the system with N = 2 species S'l , 5*2 and M = 2 reactions 

given by 

Si -^ S2, S2 ^ Si. 

Here the first reaction is one where one Si is converted into one S2 and the second 
reaction is precisely the reversal of the first. The stoichiometric vectors are given by 
vi = (—1,1)-'" and 1^2 — (1,— 1)"^- In the standard model of chemical kinetics the 
propensity functions for this example are given by ai(x) — ciXi and 02(0;) — C2X2 
and in general the propensity functions are derived from combinatorial considerations 
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and hence are polynomials [1]. In this paper however we allow more general form for 
the propensities as we do not want to limit ourselves to models arising in chemical 
kinetics. 

The time evolution of the probabilities p{t; x) = Prob(X(t)=x) is governed by the 
Kolomogorov's forward equations 

d *^ 

^P(^; x) = Y^[aj{x - v,)p{t] X - Vj) - aj{x)p{t; x% (1.1) 



where the functions aj are understood to be zero if a; — Vj ^ Zl^, and this is typically 
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an infinite system of ODEs indexed by a; € iJf. While the initial condition in general 



may be an arbitrary initial distribution p(0; x) on 1j^, it is adequate to study the case 
of deterministic initial conditions, i.e. p(0; x) = 5xa {x) in order to make conclusions 
about the general case. 

In many practical examples, the system is bound to stay in a finite subset of Z;^ 
which is determined by the initial state xq . In the above example Si — > ■S'2 , 5*2 -^ Si, 
it is clear that the total number of species Xi{t)+X2{t) is conserved for all time t>Q. 
As a result the system shall remain in a finite subset of "L^ . While such conservation 
laws and the consequent boundedness of the system are easy to spot for small systems, 
it may be difficult to decide for a large system. In this paper we develop a systematic 
theory of boundedness of species and provide necessary and sufficient conditions based 
on results from the study of convex cones in finite dimensions. 

While (|l.ll) forms a linear system of equations, analytical, or even numerical 
computations of pit; x) is often unwieldy even for bounded systems. In applications 
it is often of interest to know the moments i?(||X(i)||'') for r G N where ||.|| is some 
norm on R^. When the propensity functions are linear (or affine), it is possible to 
derive evolution equations for the moments which are closed. However, for nonlinear 
propensities it is not straightforward to even to decide if the system has finite moments 
let alone compute those. 

The time evolution of expected value of some function h of the state, E{h{X{t))), 
satisfies the so called Dynkin's formula 

While it is tempting to use h{x) = \\x\\^ to derive the time evolution of the rth 
moment £^(||X(i)||''), care must be taken as the above equation may not hold for 
unbounded functions h. In this paper we derive with care some sufficient conditions 
for the moments £^(||X(i)||'') to exist for all r G N and satisfy an exponential (in 
time) growth bound. We also provide a necessary condition for moments i?([|X(i)[|'') 
to exist for all r and alH > 0. 

Some sufficient conditions in the form of one-sided Lipschitz condition may be 
found for stochastic differential equations (SDEs) driven by Brownian motion in [5l[6]. 
The class of processes studied in this paper are of a different form and consequently 
our results are of a different flavor. 

The rest of the paper is organized as follows. In Section [2] we develop some 
mathematical preliminaries and provide necessary and sufficient conditions for what 
we call the stoichiometric boundedness of species. The analysis in this section is purely 
deterministic. In Section |3] we provide three main results, two sufficient conditions 
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and a necessary condition for the existence of all moments for all time i > 0. We 
illustrate our results via examples where appropriate. 

2. Preliminaries and boundedness of species. A chemical system or a sys- 
tem is characterized by a stoichiom,etric m,atrix v G Z^^*^ and a propensity function 
a : Z;^ — >■ M.^ . When necessary the propensity function may be extended to the 
domain Z^ to be zero outside Z^. Associated to a chemical system and an initial 
condition x e Z^ is a Markov process X{t) in continuous time with X{0) = x (with 
probability 1) as described in the introduction. We shall assume the process X to 
have paths that are continuous from the right with left hand limits. We assume that 
the process X is carried by a probability space (J7, J^, Prob). 

We shall say that a propensity function is proper if it satisfies the condition that 
for all X S Z^ if X + Vj ^ Z^ then aj{x) — 0. We note that properness is necessary 
and sufficient to ensure that the process X remains in Z;^ when started in Z;^. We 
shall say that the propensity function is regular if it satisfies the condition that for 
all X G Z^, and all j = 1, . . . , M, aj{x) = if and only if a; + Uj ^ Z^. We observe 
that regularity implies properness. Throughout the rest of the paper we shall assume 
properness. When regularity is assumed, it will be stated explicitly. 

Consider a system with A^ species reacting through M reaction channels. We 
define the accessible set of states Ax C Z{^ given an initial state x 6 Z^ by the 
condition that y G Ax if and only if there exists i > such that 

Pioh{X{t) = y I A:(0) = x) > 0. 

We observe that from standard Markov chain theory [1] the above definition is un- 
changed if the phrase "there exists t > 0" is replaced by "for every i > 0" . Further 
more y £ Ax if and only if there exists a finite sequence (ji, J2, ■ ■ ■ ,jn) of indices 
which take values in {!,..., M} such that for y^'^ where I — 0,1, ... ,n defined by 

y('+i)=2/(0+j.,, / = 0,l,...,n-l, 

with ?/^"^ — X it holds that 

a,,(2/('-i')>0, l = l,...,n. 

It is convenient to define the stoichiometricaly accessible set Sx C Z^ given an 
initial state x G Z^ by 

5:, = {y e R^ I 3w e Zl' such that y = x + i^v}r\R^ 
= {y e Zl I 3v e Z*^ such that y = x + vv}. 

(The second equality follows logically). 

It is clear that Ax C Sx. However these sets are not always equal as seen from 
Example 1. 

Example 1: Consider a system with N = M — 2, i^i = (3,-2)-^ and 1^2 = 
(—2,3)"^. Consider the initial state x — (1,1)"^. Under the assumption of proper 
propensity function, at the initial state, propensities of both reactions are zero since 
the firing of either of the reactions will lead to a state with negative components. 
Thus Ax = {x}. However Sx contains an infinite number of elements as choosing 
k — {n, n)^ where n is a positive integer results va y = x + vk ~ (1 + n, 1 + n)"^ which 
are all in Sx by definition. 
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For i — 1, . . . , A^ let TTi : M.^ ^ R be the standard projection onto the ith 
coordinate. Then if Tri{Ax) is bounded above we may conclude that species i is 
bounded for initial condition x. Deciding whether TTi{Ax) is bounded above is harder 
than deciding whether T:i{Sx) is bounded above. So we shall focus on the latter first. 
We shall use the terminology that species i is stoichiometricaly bounded for the initial 
condition x G Z^ provided TTi{Sx) is bounded above. As we shall see it turns out that 
stoichiometric boundedness is independent of the initial state x and hence we could 
drop the reference to initial state when talking about stoichiometric boundedness of 
a species. 

In order to study the sets Sx it is instructive to consider the related sets Cx and 
C+ defined as follows. Given x e R^ we define Cx and C+ as follows: 

Cx = {yeR'^\3ve R+ such that ij = x + vv), (2.2) 

C+^Co^nR^. (2.3) 

We note that Cx is a closed convex cone with vertex x and Cx is a closed convex set. 

Lemma 2.1. Let A e R'^^" and B 6 Z*^^". Suppose there exists v e R" such 
that Av > and Bv — 0. Then there exists w € Z" such that Aw > and Bw = 0. 

Proof. Define 

P = {u eM.\\ Au > 0, Bu = 0}. 

Note that P is nonempty, a cone with vertex and is relatively open in ker(i?). Since 
B has integer entrees and ker(_B) n R" is nonempty, it follows that ker(_B) n Q" is 
nonempty. As a relatively open set in ker(_B) flR", the set P contains elements from 
Q" . Since P is a cone with vertex 0, by taking a suitable positive integer multiple we 
can conclude P contains elements from Z" . D 

Corollary 2.2. Let A e R'=^" and B e Z''^". Suppose there exists v e W^ 
such that Av > and Bv > 0. Then there exists w G Z!f. such that Aw > and 
Bw > 0. 

Proof. Follows from Lemma \2A\ D 

Lemma 2.3. Let 1 < i < N and x G R^. Then Tri{Cx) is bounded above if and 
only if for every z G Cx if Zi > xi then z — x has at least one negative component. 

Proof, only if: Let z G Cx and suppose Zi > Xi. If for all A > 0, the vector 
x+\{z—x) has no negative components then it would imply that 7ri(C^) is unbounded. 
Thus there exists A > such that x + A(z — x) has at least one negative component. 
This implies that z — x has at least one negative component. 

if: For any z G C+ \ {x} define L^ by 

L;, = {y G R+ I 3A > such that y = x + \{z - x)}, 

which will be a closed line segment (may be infinite). By assumption the set iTi{Lz) is 
bounded above. To see this if Zi < Xi then Tri(Lz) is bounded above by Xi. If Zi > Xi 
then Lz is a finite segment since z — x has at least one negative component. Since 
Cx may be partitioned into sets of the form L^ , what is left to be shown is that there 
exists a common upper bound M > such that ■ni{Lz) is bounded above by M for 
ah z G C+. 

To see this define ff:C+\ {x} -^ R by 

/f (z) = maxjyi \y G L^} = niax(7rj(L^)), 



which is well defined. It is not difficult to show f^ is continuous on C+ \ {x} and 
constant on the sets L^, z ^ C+ \ {x}. Hence on the compact set 

{z/GR"|||y-x|| = i}na+ 

/f attains a maximum value say M. It follows that TTi{C^) has maximum value M. 
D 

Corollary 2.4. Let 1 < i < N and x G Z^. Then tt^^Sx) is bounded above if 
and only if for every z d Sx if Zi > Xi then z — x has at least one negative component. 

Proof, only if: If ■ni[Sx) is bounded above then so is T^i{C^) and by Lemma [ 
the result follows. 

if: Suppose 'Ki{Sx) is unbounded above. Then so is 7ri(C^) and by Lemma [ 
there exists y G C+ such that yi > Xi and y > x. Hence there exists v S R^ such 
that iiv > and i/v > Q where /i is the ith row of i^. By Corollary 12.21 there exists 
w G Z;^ such that /iw > and I'w > 0. Taking z — x + vw show that there exists 
z & Sx such that Zi > xi and z > x. U 

Lemma 2.5. Let 1 < i < N and x G R^ . Then TTi{C^) is bounded above if and 
only i/7ri(C(^) is bounded above. 

Proof, only if: We note that Cx = {x} + Cq and hence 

(Co n M^) + {x} = Cxn (Rf + {x}) cCxH R^. 

Thus TTi{CQ + {x}) is bounded above and hence so is 7r,i(C(|'). 

if: Suppose 7ri(C^) is unbounded above. Then by Lemma [^751 there exists z G C+ 
such that Zi > Xi and z — x >Q. This implies z — x (z Cq and (z — x)i > 0, which in 
turn implies that 7rj(C[J") is unbounded above. D 

For X G Z^ the study of Sx reduces to the study of C^ because of the following 
lemma. 

Lemma 2.6. Let 1 < i < N and x G Z^. Then Tri{Sx) is bounded above if and 
only if TTi(C^) is bounded above. 

Proof, if: Follows since Sx C C+. 

only if: Let ji G Z*^ be such that fi^ is the ith row of v. If TTi{C^) is unbounded 
above then by Lemma [2.31 there exists z G C+ such that Zi > Xi and z > x. Hence 
there exists v G R^ such that jjL^v > and vv > 0. From Lemma 12.11 we may 
conclude that there exists w G Z*^ such that fi^w > and uw > 0. It follows that 
the sequence y*-"-' defined by y(") — Xi + nfi^w is a sequence in 7ri(5a;) that tends to 

+00. n 

Corollary 2.7. Let 1 < i < N and x G Z^. Then Tri{Sx) is bounded above if 
and only i/7rj(Cg ) is bounded above. 

Proof. Follows from Lemmas 12.51 and 12.61 D 
Suppose a certain non-negative linear combination 

aiXi{t)-\ hajvXjv(t) 

of species is always nonincreasing with time and suppose ai > 0. Then we can write 

to conclude that species i is bounded. The existence of a nondecreasing non-negative 
linear combination can be equivalently stated as the existence of a > such that 
a^v < 0. 



However the fact that the converse is also true is not obvious and requires resuhs 
from the study of convex and cone sets as seen in the following theorem which provides 
a necessary and sufhcient condition for stoichiometric boundedness of a species. 

Theorem 2.8. Species i is stoichiometricaly bounded if and only if there exists 
a vector a G Z^ such that a > 0, ai > and a^ v < 0. 

Proof. We shall use Corollarv l2.7l to work with Cq . 

if. For all y e Co there exists v G R^^ such that v > and y = vv. Now suppose 
y G Cq . Then a^y > 0. However, since a^i' < 0, and w > 0, we have that 

a y = a vv <Q. 

Thus a^y — 0. Since a^ > it follows that yi = 0. Hence ■Ki{CQ) = {0}, and is 
bounded above. 

only if. Define the set Bq by 

Bo = {aeR^\a^iy < 0}, 

and note that Bq = {Cq)° i.e. the polar of Cq. (See Appendix for some basics on 
convex analysis and definitions). To see this suppose a G Bq. li y G Cq then there 
exists -y > such that y = vv and hence a^y — aw < 0. Hence a G {Cq)°. Conversely 
if a G (Co)° then for all y G Co it holds that a^y < 0. Since vi, . . . , vm & Cq it follows 
that a^v < and thus a £ Bq. 

Since 7ri(C(^) is bounded above it follows that yt — for all y G Cq . To see this, 
suppose y G Cq and j/i > 0. Since Cq is a cone by taking positive multiples of y we 
can obtain arbitrarily large elements in 7ri(CQ ) violating the assumption that 7ri(CQ ) 
is bounded above. Hence e^ G M^ (zth standard basis vector) satisfies efy = < 
for all y G Cq and therefore by definition e^ G {Cq)°. 

Now using (M^)° = -M^, Bq = (Co)° and Lemma[3l]we have that 

(C+r = (Co n R^r - cl((Co)° + (M^)°) = cl(Bo - K^). 

Since Bq and M.^ are polyhedral so is Bq — R'^ and hence Bq — M.^ is closed. Thus 
Bi E Bq — M.^^. So ei — a ~ u for some a G -Bo and u G M.^. Hence a = u + Ci and 
thus a > and ai > 0. Since a G Bo it follows that a^iy' < 0. 

Thus we have shown that there exists a G M.^ such that a^ > and a^i' < 0. By 
Corollary [221 it follows that we can choose such a G Z^. 
D 

The following corollary is immediate. 

Corollary 2.9. A subset I C {1, . . . , N} of species is stoichiometricaly bounded 
if and only if there exists a vector a G 1^^ such that a > 0, a.i > for i E I and 
a'^v < 0. 

In order to facilitate the discussion of boundedness of species we shall define 
the notion of a counting sequence as follows. A finite sequence (ui, . . . ,Um) where 
Uj G Z*^ is said to be a counting sequence provided mi = and for j = 1, . . . , m — 1 
Mj+i — Uj has precisely one component of value 1 with all other components being 
zero. The following lemma is immediate. 

Lemma 2.10. Suppose the propensity function is regular. Then for given x G "^^ , 
a state y G Ax if arid only if there exists a counting sequence (ui, . . . , Um) in Z*^ such 
that 

X + vuj > 0, j = 1, . . . , m, 
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and y — X + lyu^^ . 

Proof. If y G Ax there must be a sequence of reaction events which can move the 
state from x to y without leaving Z^. Conversely if there is such a sequence then 
under the assumption of regularity of the propensity function, such a sequence will 
have nonzero probability of happening. D 

Finally we have the following theorem which relates boundedness of a species with 
its stochiometric boundedness. 

Theorem 2.11. 

1. If species i is stoichiometricaly hounded then it is hounded. 

2. Conversely if species i is stoichiometricaly unhounded and the propensity func- 
tion is regular then the species i is unbounded for all sufficiently large initial 
conditions. 

Proof. The first part is obvious. We shall prove the second part. Since the species 
i is stoichiometricaly unbounded, from CoroUarv 12.41 there exists v e Z*^ such that 
fl^v > and vv > Q where /i^ is the ith row of v. Let ui, U2, . . . , u^ be a counting 
sequence with Um = v and define x £ Z^ by the condition that for i = 1 , . . . , A^ 

Xi = maxjO, -{i^ui)i, ~{i'U2)i, . . . , -{vu„i)i}. 

Then for all x G Z^, satisfying a; > a; we have that 

X + lyuj > 0, j =^ 1, . . . ,m. 

Thus it follows by Lemma r2. 101 that x + iyv £ Ax. Define the sequence (j/*'"-') for n £ N 
by y = X + nvv. It is easy to show using mathematical induction that y^"' G Ax 
for all n and that y^ is strictly increasing so that TTi{Ax) is unbounded above. 
D 

3. Moment growth bounds. In order to facilitate the development of results 
concerning moment growth bounds we shall define critical species and critical reactions 
as follows. 

We say that species « is a critical species if and only if it is not stoichiometricaly 
bounded. Without loss of generality we assume that the species are ordered such that 
the copy number vector x — (y, z) € Z_|_'' x Z_|_^ " where y is the copy number vector 
of critical species, z is the copy number vector of non-critical species and Nc is the 
number of critical species. A reaction channel j is non-critical if and only if there 
exists H : Z^"^'= -^ R such that 

aj{x) < Hiz){\\y\\ + 1), Vx = {y,z) e Z^. 

In other words critical reactions are those whose propensities grow faster than linearly 
in the critical species. We shall use Mc to denote the number of critical reactions. 
Without loss of generality we shall assume that the reaction channels are ordered so 
that j = I, . . . , Mc correspond to the critical reactions. 

In what follows, given a system with stochiometric matrix v, we define the NcXM 
matrix v^ termed the critical species stoichiometric matrix to be the submatrix of u 
consisting of the rows 1, . . . , Nc corresponding to the critical species and we define the 
{N — Nc) X M matrix v^ termed the non-critical species stoichiometric matrix to be 
the submatrix of v which consists of rows Nc -\-l, . . . , N corresponding to non-critical 
species. We also define the Nc x Ale matrix v'^ termed the critical stoichiometric 
matrix to be the submatrix of v consisting of the rows 1, . . . , Nc corresponding to the 
critical species and columns 1, . . . , Mc corresponding to critical reactions. 
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We first state a lemma. 

Lemma 3.1. Suppose a system has regular propensity functions. Let J C {1, . . . , A/} 
he a subset of reactions. Then the following are equivalent: 

1. There exists a norm ||.|| in M.^ such that the following holds: for all x £ Z;^ 
and for all j & J 

x + j^j ez^ ^ \\x + j^j\\ < \\x\\. 

2. For the system consisting only of the reactions in J all the species are stoi- 
chiometricaly bounded. 

3. There exists a G 1^ such that a > and ct^Vj < for all j G J. 

Proof. First we note that conditions 2 and 3 are equivalent by Corollarv l2.9l It is 
also clear that 1 implies 2 (and hence 3). Thus it suffices to show 3 implies 1. Suppose 
3 holds. Define the norm ||.|| on R^ by 



kii = E" 



N 



1=1 

Let x £ Z^ and suppose x + h'j G Z^ for some j G J. Then 

N N N 

W^ + ^]\\ = '^Oii{xi + Vij) = '^aiXi +Ea,;i'y = I|a;|| +a^i^j < \\x\\. 

1=^1 i=l i—1 

D 

We remark that Lemma [3.11 is typically used with J — {l,...,Mc}, the set of 
critical of reactions. 

In order to discuss how moments -E(||X(i)||'") evolve in time, first we note that 
the generator A of the Markov process with stoichiometric matrix v and propensity 
function a is given by 

M 

iAh){x) = Y^ {h{x + Vj) - h{x)) aj{x), (3.1) 

where h : Z^ -^ M and we use the convention that h{y) — if y ^ Z^. We note that 
A is regarded as an operator on the Banach space C of bounded functions h : Z^ — > R 
and that the domain of A is not all of C as Uj are typically not bounded functions. 
However the collection of all functions h that are constant outside a compact subset 
of Z{^ are in the domain of A. 

It follows from standard Markov process theory that for all functions h : Z^ — ;■ R 
in the domain of A the following formula, some times known as Dynkin's formula, 
holds for alH > 0: 

, M 

-E{h{X{t))) =J2e mX{t) + ^,) - hiXit))) a,{Xm , (3.2) 

or equivalently in integral form 

M 



E{h{x{t))) = E{h{xm) + E / ^ mx{s) + ^, 



h{X{s)))a,{X{s))\ds. (3.3) 



We suggest [5] as a general reference. 

For r G N we define the class P,. to be the set of functions / : iJ^ — > R character- 
ized by the condition that / e P^ if and only if there exist H > such that 

|/(x)|<i/(||a;|r + l), VxeZ^, 

and define P+ to denote the subset of P^ consisting of non-negative functions. We 
also define P by 



P=y^(: 



>i+^ r, 



and P"*" to denote the subset of P consisting of non-negative functions. We observe 
that the definition of classes P^ , P is independent of the choice of norm on R^ . We 
establish a few lemmas about classes Pr,P first. 

Lemma 3.2. Suppose r, s £ Z_|_ and r < s. Then there exists H > such that 

||x|r<ff||xf, xeZ^. 

Thusfr (Zfs- 

Proof. This clearly holds for x = and for x that satisfy ||a;|| > 1 it holds with 
H = 1. Since the set of x for which ||x|| < 1 is finite one may find H large enough for 
this to hold for aU x G Z^. D 

Lemma 3.3. The classes Pr.,P are vector spaces (over's.) and any (multivariate) 
polynomial belongs to class P. Suppose f G Vr, y € 1 and g : 1i^ -^ M. is defined 
by g{x) — f{x + y) if x + y E 7L^ else g{x) == 0. Then g G Pr- In other words P^ 
(and hence V) are shift invariant. Finally if f £¥r and g G P^ then h G Ps+r where 
h = fg. 

Proof. It is trivial to see that P^ is a vector space. Given /, g G P by Lemma [321 
there exists some r G Z+ such that /, 5 G Pr. Hence it is clear then that P is a vector 
space as well. 

In order to show that all polynomials belong to P it is adequate to show that all 
monomials p{x) = x^ where j3 — (/3i, . . . , j3m) S '^^ and 

X ct]^ . . . Jj^ , 

belong to P. Indeed 

where j3q — max{/3i, . . . , 13 n}- Using equivalence of norms there exists K independent 
of X such that 

\x^\<K{\\xf° + l), VxgZ^. 

To show shift invariance it is adequate to note that for r G Z+ and x,y E Z^ 

\\x + y\r < {\\x\\ + \\y\\y < J2j^7^,M%\r' < i^.(ii.^ir + 1), 

1=0 '^^ ^' 



where Kr depends on y, r and is obtained in part by Lemma 13.21 Finally if / G Pr 
and 5 G Ps and h = fg then for some H > and some H' > independent of x we 
have 

\f{x)g{x)\ < H{\\xr + m^r + 1) < H'{\\xr+^ + 1), 
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where we have used Lemma 13.21 D 

Equations l\'3.2\i and p.3p hold for h that are constant outside a compact set. The 
following lemma shows that under suitable assumptions these equations hold for all 

he P. 

Lemma 3.4. Let r e N and suppose that E{\\X{t)\\'^) < oo for all t > 0. Then 
for every f G Pr, E{\f{X{t))\) < oo for every t > and E{f{X{t))) is continuous in 
t fort> 0. 

Suppose in addition that the propensity functions Oj for j = 1, . . . , Af all belong 
to class Pg where I < s < r. Then for each f £ Pr-s, E{f{X{t))) is continuously 
differentiable in t for t > and (j3.2p . (J3.3I) hold with h ^ f . 

Proof. Given / G P^, the claim E{\f(X{t))\) < oo is obvious under the assump- 
tions. 

To show E{f{X{t))) is continuous in t we first consider / G P+. For each K > 
define f^ : iJ^ — > M by f^ {x) = f(x)f\ K , where a/\b denotes the minimum of a and 
b. Since for each K, f^ is constant outside a compact set, Dynkin's formula p.2p 
(with h = /^) holds showing E{f^ {X{t))) to be differentiable and hence continuous 
in t. Since /^ t / as X t oo, by monotone convergence E{f^{X{t))) t E{f{X{t))) 
as X t oo. Hence Dini's theorem and a standard argument show that E{f{X{t))) is 
continuous in t for i > 0. For / G Pr the proof is completed by decomposing / into 
its positive and negative parts, f = f^ — f^ ■ Thus we have established that for every 
/ G Pr, E{f{X{t))) is continuous in t for t > 0. 

To show the second part we consider / G Pr-s and for ii' > we consider the 
integral equation (|3.3p with h = f^. We observe that since Oj G P^, if / G Pr-s then 
A(f^) G Pr, Af G Pr and that f^{X{t,uj)) -^ f{X{t,uj)) for almost ah {t,uj) as 
iC t oo where the Lebesgue measure is used for t > 0. Next we bound A{f^) as 

M M 

\{Af''){x)\<Y^f'<{x + u,)a,{x)+J2f^{x)a,{x)<g{x), 
i=i j=i 

where 

M M 

and we also observe that g G P^. Thus E{g{X{t))) is finite and continuous in t 
and thus /^ £'(g(X(s)))ds < oo for each i > 0. Hence the dominated convergence 
theorem allows us to conclude that one could take the limit as iiT ^' oo on both sides 
of (|3.3p with h ~ f^ to conclude that the equation holds for h = f e Pr-s '^^ith all 
terms being finite. This shows E{f{X{t))) to be continuously differentiable in t for 
/ £ IP^-s- The proof is completed for / G Pr-s by decomposing / into positive and 
negative parts. 
D 

Lemma 3.5. Suppose </> : [0, oo) — s> M is strictly positive for all t > 0, differentiable 
at and suppose there exist H > and A G M such that for all t > 0, 

(t>{t) < i/0(O)e^*. 

Then there exists /i G M such that for all t > 0, 

0(i) < (/.(O)e'^*. 
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Proof. We observe that for t > 0, 

Mm) - ln(0(O)) ^ ln(g) , 
t - t ' 

We note that the right hand side is bounded for t > Iq for every ip > 0, and the left 
hand side is bounded for t g (0, ig] for some to > since the hmit as t — > 0+ exists 
and is finite by assumption. Hence the left hand side is bounded for t e (0, oo). We 

set 

, ln(0(O) - ln(^(0)) ^ ^ 

fi — sup < r < oo, 



sup<^ - 

t>Q '- 



t i 



to obtain the result. D 

The following theorem provides a sufficient condition for exponential moment 
growth bounds. 

Theorem 3.6. Let v'^ he defined as above and suppose propensity functions belong 
to class P. Suppose further that there exists a G Z , " such that a > and a^v'^ < 0. 
Then for each r G N there exists /i^ such that the following holds for all t > and in 
any norm \\.\\ onM.^: 

E{\\X{t)\n < S(|lX(0)|r)e^'-* + e^-* - 1. (3.4) 



Proof First we claim that there exists 7 = (71,72) £ Z^ where 71 G Z_^_'' 
and 72 e Z^-^' such that 7 > 0, jfi^j < for j = 1, . . . ,Mc and 7J1/2 < for 
j = 1, . . . , M where v^, v^ are as defined earlier. To see this we first observe that by 
Corollary HH there exists /3 = (/3i,^2) e Z^ where /3i G ill" and ^1 G Z^"^^ such 
that fi^v^ < 0, /3jz/^ < and /32 > 0. Set 71 = /3i + a and 72 = /32 to obtain the 
desired result. 

We shall use the norm defined by ||a;|| — j'^\x\ (where |a;| — (|xi|, |x2|, . . . , I^^AfD) 
and for a; > we have that ||a;|| = -/'^x. For r G N and if > define fr, f^ : Z^ ^ R 

by 

fr{x) = \\xr, f,^{x) = \\x\\^AK. 

We shall define fr, f^ to be zero outside 1^. It follows that f^ are constant outside 
a compact set for each K > Q (and hence in the domain of the generator A) and 

f^ t /r as if t 00. 

We write {Af^){x) = Y^Li Tj where 

T, = [f^<{x + iy,)-ffix)]a,{x). 

We note that aj{x) — and hence Tj — 0, unless x G 'Z^ and x + i^j G li^. Since we 
seek a non-negative upper bound for Tj we shall only consider the case when x G Z;'^ 
and X + Vj G Z^. 

When J = 1, . . . , Mc, due to the choice of our norm, we obtain that for x — (y, z) 

\\x + i^j\\ ^ iiy + 12 z + iiv] + i2v'^3 <ily + ilz^ \\x\\- 

Given this, we obtain that Tj < regardless of the value of K. 
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To bound Tj for j — Mf. + 1, . . . , M, we consider the ordering of the three terms 
llx + j/jll'', ||a;||'' and K. If ||a;||'' > K then regardless of the value of ||a:: + ^'j|| we obtain 
that 



T, < 0. 



If 1 1 a; 1 1'' < K then regardless of the value of ||a; + i^j [|'" we obtain that 

T, < [\\x + i.,r M>,{x) = [(ii2:ii +7f^i +7i^^|r - ii.^irK(^) 
< [(ii.x|| + 7^^})'- - \\x\na,{x) < H{z) (y2 i!(7r7)Tii^ii'(^^^l)''"') di^^n + 1) 

< H{z)K.{\\x\\^ + 1) = i7(z)A;(||x|r AK+l), 

where A^ is a constant that does not depend on x or K and the Leinnia l3.2l has been 
used. On account of positivity of the above upper bound, it provides an upper bound 
for Tj when j = Mc + 1, . . . ,M regardless of whether ||x||'' < K or not. 
Thus we obtain the bound 

{Af^'){x) < {M - M,)\',H{z)f^{x) + {M - M,)KH{z). 

Hence we obtain 

|i?(/f (X(t))) < (M - KQKE[H{Z{t))f^{X{m + (A/ - M,)KE[H{Z{t))]. 

Using the fact that the vector copy number Z{t) of the non-critical species is bounded, 
we obtain that 

±EiU^ixit))) < KE{f^{X{t))) + K, 

where A^ is another constant. The Gronwall Lemma yields that 

E{f^{X{t))) < i?(/f (X(0)))e^-* + e^-* - 1, t>0. 

Taking limit as K ^ oo and using the monotone convergence theorem we obtain 

E{fr{X{t))) < E{fr{X{0)))e^^' + e^-* - 1, i > 0. 

Hence in the specific norm ||x|| = 7"^|a;| we obtain 

^(ll^(i)ir) < ^(||X(0)|r)e^'-* + e^"* - 1, i > 0. 

Using the equivalence of norms in R^ we obtain the bound (in any given norm) 

E{\\X{tW) < LrE{\\X{0)\ne^'''+Lre^^' - U, t> 0, 

where L^ is a constant that depends only on the norm used and on r and considering 
i = it is clear that L^ > 1- Define (/)(t) by 

</)(i)-ii;(||x(i)ir) + i, ^>o. 

Then (j){t) > for t > and it follows that 

0(t) < L^0(O)e^'-* + (1 - Lr) < L.r0(O)e^'-*. 
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By Lemma 13.41 it is clear that (p is continuously differentiable in t for t > 0. Lemma 

13.51 clinches the desired result. 

D 

Example 2 Consider the system with two species and two reactions given by 
i^i = (2, —1)"^, 1^2 — (—1, 1)^ and ai{x) = x\ and a2{x) = xi. Since 2ui + 'iv2 = (1, 1)"^ 
it is clear that both species are critical (as they are stoichiometricaly unbounded). 
However only reaction 1 is critical. Thus the critical stoichiometric matrix is the 
column vector vi. The choice of 7 = (1,3)"^ satisfies "f^vi = — 1 < and hence we 
can conclude that the moments of all orders exist and satisfy the exponential in time 
growth bound. 

The conditions of Theorem l3.6l are not necessary to ensure that a moment growth 
bound of the form p.4p holds. 

Example 3 Consider a birth/death process with birth rate ai{x) = x™ and death 
rate 02(2;) = 2x™. Then z^i = 1 and 1^2 — ~\ and the critical matrix v'^ = (1,-1). 
The conditions of Theorem 13.61 are not met if to > 1. Nevertheless, intuitively one 
expects the birth rate to be compensated by the death rate of the same form but of 
a dominant magnitude. If we set fr{x) ~ x^ then 

{AU){x) = {{x + ly - x'-)x"') + 2 ((x - l)"^ - a;'')a;") 

= E 777^^'^" + 2 y 777^ (-1)''"'^'+" 
1=0 ^ ' i=a ^ ^ 

When m = 2 (quadratic birth/death rates) the positive term with highest power of 
X is 3r(r — l)a;''/2 and suitable truncation and Gronwall Lemma may be used to 
obtain an exponential growth bound on all moments. If ?7i > 2 then the positive term 
3r(r — l)a;'""'"'"~^/2 is a higher power than x^ and unless r = 1 (in which case finiteness 
can be shown easily regardless of m) this approach does not work. 

Thus the intuition suggested above may only be valid if the propensities are 
quadratic at most. 

Example 4 Consider a two species {Si and S2) model where when one Si and 
one 5*2 come together one of three things can happen; the birth of an Si , the birth of 
an 5*2 or the death of both Si and ^2. This may be depicted by 

51 + ^2^ 2^1 + 52, Si + S2^Si + 252, 5i + 52 ^ 0. 

Thus we have vi = (1,0)^,1^2 = (0, 1)"^ and I's = (—1, —1)^. It is easy to see that 
both species are critical. 

Suppose the propensities ai, 02, 03 for these reactions are given by 

ai{x) = a2ix) = X1X2, a3{x)^2xiX2. 

Hence all three reactions are critical. Here again the conditions of Theorem 13.61 are 
not met. However the fact that one occurrence of the third reaction undoes one 
occurrence of both of the other two and the dominant rate of the third reaction might 
suggest the possibility of bounded moments. 

Let us use the 1-norm and set fr{x) = ||a;||''. We obtain that 

{Afr){x) ^ [{y + ly ~ y^]ai{x) + [{y + ly - y^]a2ix) + [{y - 2y - y'-]as{x), 
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where y — X1+X2 and we suppose x = (xi, 0:2) > 0. Setting ai — a2 — a and a^ = 2a 
and simplifying we obtain 



iAfr){x) = 2a{x) Y: J^^^^y' + 2«(x) E l!(737)! (-2)^^'y' 
= {~ry''~'^a{x) + 5r{r ~ l)y''~'^a{x) + ...). 

Since a{x) = a;iX2 < ||a;|p = y^, similar to the m = 2 case in Example 2, we may 
expect to obtain exponential growth bounds on all moments. However if a(x) did not 
satisfy quadratic growth bound such bounds may not hold. 

The two examples above are examples of application of the following theorem. 

Theorem 3.7. Suppose that propensity functions all belong to class P and that 
there exist C > and 7 6 M.^ such that 7 > and 

N 



YFix)<C{\\x\\ + l), VxGZ^ 



^M 



where F{x) = X]7"=i ^j^ji^)- Further suppose there exists H > such that for all j 



with 7^i^j 7^ 






aj{x) <H{\\xf + l). 



Then for each r G N there exists fir such that equation p.4p holds. 

Proof. Define fr,ff as in the proof of Theorem 13.61 We write {Aff){x) = 
Ejii Tj where 

T, = [f,^{x + iy,)-f,^{x)]a,{x). 

We choose the norm defined by ||a;|| = 7^|a;| where |x| = (|a;i|, \x2\,. . . , \xn\). When 
||xf > K we have that Tj < 0. When \\x\\'' < K, we obtain 

T,<[ij^x + ^^i.,y-{j^xr]a,ix) 



r(7^x)'-i7^^,a,(x)+V— ^(7^:.,r'(7^x)'a,(x) 



r-2 

^ll(r~-l) 

< r(7^xr-S^;.,a,(x) + i7;(||x|r- + 1), 

= r{ci^xY~^-i^v,a,{x) + B',{\xW A X + 1), 

where H'^ is a suitable constant. We note that for some j if ^^ Vj = then there 
are no conditions on the form of the propensity function Oj . Otherwise the quadratic 
growth bound on aj ensures that an upper bound with highest power of at most ||a;||'' 
is obtained. This leads to a bound of the form 

{Afr^){x)<Xrfr^ + Xr, 

where A^ > is a suitable constant. The rest of the proof is similar to that of Theorem 

inn D 

The next theorem provides a necessary condition for the boundedness of all mo- 
ments for all time t > 0. 

Theorem 3.8. Suppose propensity functions all belong to P and suppose that 
there exist 7 G R , a > 1 and C > such that 7 > and 

j^F{x) > C||x||", Va; e Z^, 
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where F{x) — X]i=i '^j'^j(^)- Further suppose that £ "L^ is not both the initial 
and an absorbing state. Then for every r £ N that satisfies aj{x) < iJ(||a;||'' + 1) 
for all j — l,...,Af (for some H independent of x) there exists t > such that 
E{\\X{t)\\'^) = oo. (As always we assume deterministic initial condition xq.) 

Proof. We shall prove by contradiction. Suppose r e N satisfies aj{x) < _ff (||x||'" + 
1) for all j = 1, . . . ,M (for some H independent of x) and assume that for alH > 
it holds that £;(||X(i)f) < cx). Let oq = Ej^i«j- Then an e P^, E{ao{X{t))) < oo 
for i > 0, and using Lemma [3.41 it follows that E{ao{X{t))) is continuous in t. Thus 
we also have that 

t 
E{ao{X{s)))ds < oo. 

If the number of events of type j occurring during (0, t] is denoted by Rj{t) then 
E{Rj{t))^ I E{aj{X{s)))ds < oo, 



and hence Rj{t) < oo with probability 1. In other words the process is non-explosive. 
First choose a norm such that ||a;|| = 7"^|x| (|a;| = (|a;i|, . . . , \x]y\). By equivalence 
of norms, the inequality ^'^ F{x) > C||a;||" still holds with possibly a different C. For 
each K > define Mk > as follows: 

MK^snp{\\x + i^,\\\j^l,...,M,xeZl, \\x\\ < K}. 

Clearly as ii' — > oo, we have that Mk ^ oo. 

For each K > let us introduce the function /^ : Z^ ^ M by /^(x) = \\x\\AMk 
and as ivT — >■ oo, we have that f^{x) -^ ||x||. We also have that 

M 

{Af''){x)=Y,^^v,a,{x)=^^F{x), 

for ah X e Z^ that satisfy ||x|| < -ftT. 
We define the stopping times tk by 

TK = \ni{t\\\X{t)\\<K}. 

By the non-explosivity, we have that t/^ — > oo with probability 1 as iiT —>■ oo. 

We observe that p.3p holds if t is replaced by a bounded stopping time [2] . Since 
t /\tk is bounded above by t we have that 

Eif'^iXit A tk))) - /^(xo) + J2 1^^3E U a,iXis))ds] . 

For sufficiently large vq > 0, we can bound 

M 

for all X e Z^. Since as iiT — )► oo, we have that X (t A tk) ^ X (t) with probability 
1, by dominated convergence theorem, we may take limit both sides of above integral 

15 



equation to obtain that 



f r 

E{\\X{t)\\)^f{xo)+Y.^^iy,E( 

7 = 1 ^-^0 



aj{X{s))ds 



Hence we have that 

j^E{\\Xit)\\) ^ E{^^F{X{t))) > CEi\\Xit)\n > CiEi\\Xit)\\)r, 

(the last step uses Jensen's inequahty, see [5] for instance). Let (j){t) — E{\\X{t)\\). 
Thus (j) satisfies 

^0(i)>c(0(i)r, i>o. 

Under the assumption on the initial state, for every t > 0, (f>{t) > 0. Fix ii > to 
obtain (f){t) > (j){ti) > for i > ti. We obtain for t>ti, 

d f-ia-i)\_ im 





a - 


-1 




a 


!-l 




-Ct' 


(0(t: 


i))°- 


-1 



and after some manipulations we obtain 

m)r- 

showing that 0(i) = ii^(||X(i)||) is not finite for alH > reaching a contradiction. D 

We like to remark that the condition stated in Theorem 13.81 has not been shown 
to imply the nonexistence of the first order moment i?(||X(i)||) for all time t > 0. 

Example 5 Let us consider a modified version of Example 2 where vi — (2, —1)"^, 
V2 — (—1, 1)"^ and ai{x) — x\ as before, but we set a2{x) — x\. The quadratic form 
for a2 makes reaction 2 also to be critical. In order to satisfy the sufficient condition 
of Theorem 13.61 we must find 7 £ Z^ with 7 > and ^v < 0. This requires the 
conditions 

71 > Oi 72 > 0, 271 > 72, 71 < 72, 

which cannot be met. In this example the sufficient conditions of Theorem 13.71 also 
lead to the same conditions on 7 which cannot be met. On the other hand if we 
choose 7 = (2, 3)"^ then we obtain that 

j^F{x) = ai{x) + a2{x) ^ xl + x^ = |la;f . 



Thus the condition of Theorem 13.81 is satisfied (assuming initial condition is not 0) 
and since propensities are quadratic we can conclude that i?(||X(t)|p) = 00 for some 
t > . 
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Appendix. We summarize some basics from convex analysis. A set C C M" is 
said to be conwes if for each x,y € C and each a G (0, 1) it holds that ax+{l — a)y G C. 
A set K C M" is said to be a cone with vertex x e M" is for each y G K and each 
A > it holds that x + X{y — x) G K. A convex cone is simply a set that is both convex 
and a cone. A cone is said to be finitely generate or polyhedral if there exists a finite 
set of vectors vi, . . . ,Vm € R" such that y £ K ii and only if there exist Ai, A2, . . . , A„ 
all greater than or equal to zero such that 

n 

y:^x + ^XjVj, 

where x is the vertex. 

It is easy to show that polyhedral cones are closed and convex sets, i.e. closed 
convex cones. It may be shown that ii C,K C M" are polyhedral cones with vertex 
then so are C D K and C + K where the sum of two sets is defined by 

C + K = {c+k\ceC,keK}. 

The polar of a cone K with vertex is the cone K° (with vertex 0) defined by 

K° ^{ye K" \yxeK, y'^x < 0}. 

Lemma 3.9. Suppose C and K are convex cones with vertex in M". Then 

{cnxy ^ ci{c°-K°). 

Here cl refers to the closure of a set and for A, B d M" 

A-B = {a-b\ae A,be B}. 

Proof See [3] Exercise 2.12. D 
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